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Device and method for generating metadata from essence 

The present invention relates to a method for processing 
5 multimedia data including the step of providing at least one 
selected essence data, wherein essence data represents in- 
formation being directly perceptible by a user. Furthermore , 
the present invention relates to a corresponding device for 
processing multimedia data. 

10 

Background 

Multimedia data may include metadata being data about data. 
Metadata is a special kind of data, which is linked to other 
is data called essence. Metadata is typically used as index 

message for essence. Essence is the basic data, such as text 
essence, picture essence, video essence, or audio essence. 

The metadata structure is essentially characterized by two 
20 partss metadata-essence (MD-essence) and metadata-link (MD- 
link) . MD-essence is part of a metadata, which is designed 
to be human-perceptible, and which serves as the proxy by 
which the metadata will be presented to the user in any user 
interface of systems employing metadata, MD-link is part of 
25 the metadata, which links to any kind of essence. 

A way how to generate efficient metadata is always an impor- 
tant issue for metadata applications. A possible way for ge- 
nerating metadata is to convert essence into metadata. In 

30 practice, some essence, such as text essence or thumbnail 

picture essence, contains a lot of compact information which 
can be utilized for metadata. Usually, content of essence 
can be converted directly into metadata essence. However, it 
is a problem to generate MD^link data conveniently in case 

35 of conversion of essence into metadata. 
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Invention 



10 



IS 



In view of that it is the object of the present invention to 
provide a device and a method for conveniently generating 
5 MD-link data, while generating metadata from essence.. 

According to the present invention thiB object is solved by 
a method for processing multimedia data including the steps 
of providing at least one selected essence data, wherein es- 
sence data represents information being directly perceptible 
by a user, providing a metadata template to be used to form 
at least a first metadata, providing a list of links to a 
plurality of second essence data and/or a list of a plural- 
ity of second metadata and forming said at least first meta- 
data on the basis of said at least one selected essence data 
and said list of links and/or said list of second metadata 
by applying said metadata template. 

Furthermore, according to the present invention there is 
20 provided a device for processing multimedia data including 
first storing means for providing at least one selected es- 
sence data, wherein essence data represents information be- 
ing directly perceptible by a user, second storing means for 
providing a metadata -template to be used to form at least a 
25 first metadata, third storing means for providing a list of 
links to a plurality of second essence data and/or a list of 
a plurality of second metadata and processing means con- 
nected to that first, second and third storing means for 
forming said at least first metadata on the basis of said at 
30 least one selected essence data and said list of links 

and/or said list of second metadata by applying said meta- 
data-template. 

Accordingly, there is provided a basic method and device for 
35 conversion of essence into metadata for users with pre- 

knowledge for generating MD- links . Additionally, there may 
be provided an advanced method for conversion of essence 
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into metadata based on a relationship -chain between essence 
and metadata, wherein the user may be without any pre- 
knowledge for generating MD- links efficiently. In other 
words , the user is given an intelligent metadata editing 
5 method or an assistant tool for metadata editing . 



Preferably, second metadata linked with the at least one se- 
lected essence data is used for forming the first metadata. 
This is an essential help for the user to edit the first 
10 metadata. He does not have to look through the whole list of 
current metadata to find content-related further informa- 
tion. Instead of this, the user obtains a valuable hint to 
closely content correlated essence from the second metadata. 
Thus he does not have to go through the whole list of cur- 
ls rent metadata but highly relevant essence data are proposed 
automat ically - 

The at least first metadata may be formed by taking over the 
at least one selected essence into a MD-essence space of the 
20 metadata- template. This means, that the essence data or part 
of essence data are simply transferred to the metadata- 
template without any transformation. 

The at least first metadata is advantageously formed by add- 
ing one or more MD- links of the second metadata into a MD- 
25 link space of the metadata- template . This means, that the 

MD-links are simply formed by transferring the MD- links from 
other metadata into the new metadata without transformation. 



Third metadata and/or third essence data linked with MD- 
30 links of the second metadata may be used for forming the MD- 
essence and/or metadata -links of the first metadata. There- 
fore r a relation-chain of links having any length may be 
used to automatically propose a convenient metadata- 

35 Fortunately, a forming or editing process of the metadata is 
performed with the help of a graphic user interface (GUI) . 
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Such a GUT represents a comfortable assistance tool for ed- 
iting metadata. 

The present invention will now be described in more detail 
5 in connection witlr the attached drawings, showing in: 

a schedule for converting essence into meta- 
data according to a basic method of the pre- 
sent invention; and 

a schedule for converting essence into meta- 
data according to an advanced method of the 
pre s ent invent i on . 

15 Exemplary embodiments 

For conversion of essence into metadata, essence data can be 
directly converted into MD-essence. The problem is how to 
conveniently generate a meaningful MD-link for it. To solve 
20 this problem, a basic and an advanced method are described 

in the following, which utilize the relationship between ex- 
isting essence and metadata to generate a significant MD- 
link. 

25 A basic method, which converts an essence into metadata and 
utilizes other existing essence or metadata to s^et up meta- 
data references is composed as following: 

I- Basic method! 

30 

a) As shown in Fig, 1, the task of this basic method is to 
combine a selected essence 1 with a provided metadata 
template 2. The metadata template 2 includes a MD-essence 
3 and MD-link(s) 4. 

35 

b) As further shown in Fig. l, a graphic user interface 

(GUI) 5 can browse or operate the following conrponents: 



Figure 1 . 



Figure 2 
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the selected essence 1, the metadata template 2, a list 
of links to existing essences 6 and a list of current ex- 
isting metadata 7. 

5 c) Using a GUI 5 operation, the user may convert the se- 
lected essence 1 into metadata 2 through taking over es- 
sence 1 into MD-essencs 3. The essence 1 can be a text, a 
picture (such as a thumbnail picture) , an audio or a 
video- clip- If the MD- essence 3 contains a picture, an 
xo audio or a video clip, the metadata 2 is a kind of rich 

metadata. 

d) After converting essence 1 into MD-essence 3 , it still 
needs to generate the MD-link(s) , without MD-link (s) in- 

15 formation, metadata are meaningless. In this basic 

method, the user may browse a list of links to existing 
essences 6 and a list of existing metadata 7 with the GUI 
5. The user may select desired links to the present es- 
sence from the list of links to essence 6 and add the ee- 

20 lected links to MD-link 4. Furthermore, the user may se- 

lect metadata from the metadata list 7 and generate a . 
link information to the selected metadata, and add the 
generated link to MD-link 4 . 

25 e) After above editing process, a new metadata is generated, 
which is based on the metadata template 2. Its MD-essence 
3 is taken over from selected essence 1 and its MD- 
link (s) 4 is generated from list of links of existing es- 
sence 6 and metadata 7. 

30 

According to this basic method, a selected essence 1 is con- 
verted into a new metadata 2, wherein the user has to do 
most of the work of finding or generating the new MD-link (s) 
4. The user must generate a metadata link according to his 
35 own pre-knowledge or understanding. He sets up MD-link 4 
through selecting and generating a link message from 
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existing essence and metadata. In this procedure, the user 
cannot use any assistant information to simplify his selec 
tion and judgment process. However, in a lot of cases it is 
difficult to generate efficient and correct MD-link by only 
s using above basic method. Therefore, an advanced method is 
proposed here, which can make use of associated reference 
information to help the user to select efficient and sig- 
nificant MD-link (s) for the new metadata: 

io II. Advanced method: . 

a) As shown in Fig. 2, the advanced method includes all 
functions and components of the basic method as described 
above in X . (a) - (e) . 

15 

b) As alternative way to the basic method, in the advanced 
method, the user may search in a metadata database for 
all metadata B , which are linked to the selected essence 
1: The metadata 8 have their own MD-eesences 9 and MD- 

20 links 10. Each MD-link 10 directs to essence 1. 

c) The metadata B can be viewed and operated by GUI 5, 

d) The MD-essence 9 of metadata a can be used as additional 
25 reference material for editing MD-essence 3 of metadata 

2. For example, the user may take the MD-essence 9 to im- 
prove MD-essence 3. 

e) The metadata 8 provides useful hints for users. Based on 
30 metadata 8, the user may generate improved reference link 

data for the new generated metadata 2. For example, be- 
sides MD-link 10, the metadata 8 may include an other MD- 
link 11 , which links to another metadata or essence 12. 
Within metadata 8 all MD-links 10, 11 are content - 
35 associated. Therefore,, metadata/ essence 12 and essence 1 

are closely . content-related entities. Thus, meta- 
data/essence 12 is a good reference candidate for the new 
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metadata 2. In this case, metadata 2 should have a refer- 
ence link, which directs to the metadata/ essence 12 . If 
the user decides to take over the MD-link <s) 11 as refer- 
ence link into metadata 2, he can simply add the MD- 
s link(s) 11 to MD-link (s) of metadata 2. 

f ) Further, the user may make use of the hint of metadata a 
to find further content -related entities of essence 1, or 
reference link data of metadata 2, For example, the user 

10 may look for interested reference information in meta- 

data/essence 12 and generate MD-link to metadata 2 . 
Thereby the user may find other associated meta- 
data/essence 13 and generate a possible MD-link for meta- 
data 2 on the basis of metadata/essence 13 . 

is 

g) The user completes all above steps under GUI 5 operation • 

In Fig. 2. entities 1, 8, 12 f 13 ... form of a kind of rela- 
tionship-hint-chain. This relationship -hint - chain makes it 
20 possible to let the user easily find out associated refer- 
ence links for the new metadata 2 . This is a fast way to get 
desired entities from hundreds and thousands of candidates . 

The basic method and the advanced method for. converting es- 
25 sence into metadata may be employed in parallel. If the user 
has enough pre-knowledge for generating reference link data, 
the user may use the basic method described above in (I) , 
otherwise, the user may use the advanced method described in 
(II) and based on the relationship -hint -chain to generate a 
3 0 significant metadata link. 

For better understanding of the above methods the following 
application examples are given: 

35 1- A user will generate a new metadata based on an existing 
photo (essence 1) . The content of the selected photo is 
about Eiffel tower in Paris. At first, the user will con- 
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vert the photo into MD-essence 3, if the original photo 
has a big format, the new generated MD-essence photo can 
be converted into a shrunk formatted picture, such as a 
thumbnail photo. Now the user has a metadata with a MD- 
5 essence part. Second, the user must set up significant 

reference links for this metadata according to one of the 
two methods i 

a) Based on the above described basic method, the user may 
io browse lists of all existing essences or metadata and 

manually generate MD- links to preferred essences or meta- 
data, such as a film about the Eiffel tower, a biographi- 
cal article about the designer of the Eiffel tower, a 
metadata which includes many useful reference links about 
15 the Eiffel tower and Paris, etc. The problem for this 

method is that if there are a lot of possible candidate 
essences or metadata, it is difficult for the user to 
generate reference links correctly and quickly, 

20 b) Based on the above described advanced method, the user 
does not need to browse all essences or metadata. The 
user only has to check existing metadata 8 which link to 
the selected Eiffel tower photo (essence 1) . if there 
exists any metadata 8 which points to the selected photo, 

25 the user may simply check all reference links 11 of the 

metadata 6. The user may look for preferred entities fol- 
lowing these reference links 11 and select interested 
references and set up MD- links 4 for the new created 
metadata 2. When using the advanced method, the user may 

30 set up the same MD-link 4 as the above basic method, such 

as links to some films, pictures or articles about Eiffel 
tower and Paris. However, the advanced method is more ef- 
ficient and faster in caBe of larger essence and metadata 
databases . 

35 

2. A user will generate a new metadata based on a movie (es- 
sence 1) -^The Lost World (Jurassic Park II)". The user 
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may analyse the whole movie and extract some thumbnail 
pictures, a video-clip or an audio clip as key represen- 
tative entity of the movie. After that the user may con- 
vert the thumbnail pictures, the video clip or the audio 
5 clip into a MD-eseence 3 of the new metadata 2. For 

example , if the user converts a dinosaur picture into MD- 
essence 3 of the new metadata 2, he may use the advanced 
method to search for interested reference quickly from 
existing metadata, which points to the selected movie. By 

10 this way, the user may generate useful MD- links 4, for 

the new metadata 2 f such as links to movies * Jurassic 
Park I", xv Jurassic Park II", ^Jurassic Park III", links 
to some dinosaur document movies or pictures or articles, 
as well as links to some metadata which contain summary 

15 links about a dinosaur topic. 

As can be seen from the above examples, both methods provide 
a comfortable assistant tool for metadata editing. 
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Claims 



Method for processing multimedia data including the 
steps of 

providing at least one selected essence data (l) , 
wherein essence data represents information being di- 
rectly perceptible by a user, 

characterized by 

providing a metadata template (2) to be used to form at 
least a first metadata, 

providing a list of links (S) to a plurality of second 
essence data and/ or a list of a plurality of second meta 
data (7) and 

forming said at least first metadata on the basis of 
said at least one selected essence data (1) and said 
liBt of links (6) and/or said list of second metadata 
(7) by applying said metadata template (2) . 

25 2, Method according to claim 1, wherein second metadata 

linked with said at least one selected essence data (1) 
is used for forming said first metadata. 

3. Method according to claim 1 or 2 , wherein said at least 
30 first metadata is formed by taking over said at least 

one selected essence data (l) into a MD-eesence space 
(3) of said metadata template (2) . 

4. Method according to one of the claims 1 to 3, wherein 

as said at least first metadata is formed by adding one or 

more MD-links of said second metadata (8) into a MD-link 
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space (3) of said, metadatar template (2) * 

5. Method according to one of the claims 1 to 4, wherein 
third metadata and/or third essence data (12, .13) linked 

5 with MD-links (10 , 11) of said second metadata (8) are 

used for forming said MD-essence and/or MD-links of said 
first metadata. 

6. Method according to one of the claims 1 to 5, wherein 

10 the step of forming said at least first metadata is per- 

formed by a graphic user interface (5) . 

7. Device for processing multimedia data including first 
storing means for providing at least one selected ea- 

15 sence data (1) , wherein essence data represents informa- 

tion being directly perceptible by a user, 

characterized by 

20 second storing means for providing a metadata -tempi ate 

(2) to be used to form at least a first metadata, 

third storing means for providing a list of links (6) to 
a plurality of second essence data and/or a list of a 
25 plurality of second metadata (7) and 

processing means connected to said first, second and 
third storing means for forming said at least first 
metadata on the basis of said at least one selected es- 
30 sence data (1) and said list of links (S) and/or said 

list of second metadata (7) by applying said metadata- 
template (2) . 

8. Device according to claim 7, which is connectable to 
35 fourth storing means or storing second metadata (8) 

linked with said at least one selected essence data (1) , 
wherein said second metadata (8) are usable for forming 
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said first metadata. 

9. Device according to claim 7 or 8, wherein, said at least 
first metadata is formable by taking over said at least 

5 one selected essence data (1) into a metadata essence 

space (3) of said metadata-template (2) by said process- 
ing means . 

10. Device according to one of the claims 7 to 9, wherein 
io said at least first metadata is formable by adding one 

or more MD- links (10, n) of said second metadata (8) 
into a MD-link space (4) of that metadata -template (2) 
by said processing means. 

is 11. Device according to one of the claims 7 to 10, which in- 
cludes fifth storing means connected to said processig 
means for storing third metadata and/or third essence 
data (12, 13) linked with MD-links (11) of said second 
metadata (8) , wherein said third metadata and/or said 

20 third essence data (12, 13) are usable for forming said 

MD-essence and/or said MD-links of said first metadata. 

12. Device according to one of the claims 7 to 10, further 
including a graphic user interface (5) connected to said 
25 processing means for forming said at least first meta- 

data . 
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Abstract 

Device and method for generating metadata from essence 

5 The generation of metadata shall be simplified. Therefore, a 
method is presented in which a metadata- template (2) is 
filled with selected essence (1) and MD-links obtained from 
a list of links to essence (6) and/or a list of current 
metadata (7) . Furthermore, it is possible to obtain the MD- 
10 links from further metadata or essences (9 r 12, 13) directly 
or indirectly linked with the selected essence (1) . 

(Fig. 2) 
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